Weitere Korpora
- Afrikaans
- Albanian
- Amharic
-
Arabic
-
News
- 2005-2009 10K
- 2005-2009 30K
- 2005-2009 100K
- 2005-2009 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2015 10K
- 2015 30K
- 2015 100K
- 2015 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- Newscrawl
- Web
- Wikipedia
- Algeria
- Australia
- Bahrain
- COM
- Canada
- Egypt
- France
- Germany
- Iran
- Iraq
- Jordan
- Lebanon
- Mauritania
- Morocco
- Palestine
- Qatar
- Russia
- Saudi Arabia
- Sweden
- Syria
- Tunisia
- Turkey
- United Arab Emirates
- United Kingdom
-
News
- Aragonese
- Armenian
- Assamese
- Asturian
- Azerbaijani
- Balinese
- Banjar
- Bashkir
- Basque
- Bavarian
- Belarusian
- Bengali
- Bihari
- Bikol
- Bishnupriya
- Bosnian
- Breton
- Bulgarian
- Buriat
- Catalan
- Cebuano
- Central Bikol
- Central Kurdish
- Chechen
- Chinese
- Chuvash
- Corsican
- Croatian
-
Czech
-
News
- 2005 10K
- 2005 30K
- 2005-2007 10K
- 2005-2007 30K
- 2005-2007 100K
- 2005-2007 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2012 1M
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2013 1M
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 30K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Web
- Wikipedia
- European Union
-
News
- Danish
- Dhivehi
- Dimli
- Dotyali
-
Dutch
-
News
- 2005 10K
- 2005 30K
- 2005 100K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2011 1M
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Wikipedia
- Aruba
- European Union
- Netherlands Antilles
- Suriname
-
News
- Eastern Mari
- Egyptian Arabic
- Emiliano-Romagnolo
-
English
-
News
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2013 1M
- 2014 10K
- 2014 30K
- 2014 100K
- 2014 300K
- 2015 10K
- 2015 30K
- 2015 100K
- 2015 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- 2024 10K
- 2024 30K
- 2024 100K
- 2024 300K
- Newscrawl
- Newscrawl-public
- Web
- Wikipedia
- American Samoa
- Anguilla
- Antigua and Barbuda
- Ascension
- Australia
- Bahamas, The
- Barbados
- Bermuda
- Botswana
- British Indian Ocean Territory
- Brunei
- Canada
- Dominica
- European Union
- Falkland Islands (Islas Malvinas)
- Fiji
- Gambia, The
- Germany
- Gibraltar
- Guadeloupe
- Guyana
- Ireland
- Kiribati
- Montserrat
- Namibia
- Nauru
- New Zealand
- Niue
- Philippines
- Puerto Rico
- Saint Kitts and Nevis
- Saint Lucia
- Saint Pierre and Miquelon
- Saint Vincent and the Grenadines
- Seychelles
- Singapore
- South Africa
- South Georgia & South Sandwich Islands
- Thailand
- Turks and Caicos Islands
- United Kingdom
- Zambia
- Zimbabwe
-
News
- Erzya
-
Esperanto
- Newscrawl
- Web
-
Wikipedia
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2014 10K
- 2014 30K
- 2014 100K
- 2014 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- European Union
- Estonian
- Extremaduran
- Faroese
- Fiji Hindi
- Finnish
-
French
-
News
- 2002-2005 10K
- 2002-2005 30K
- 2002-2005 100K
- 2002-2005 300K
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2005-2008 10K
- 2005-2008 30K
- 2005-2008 100K
- 2005-2008 300K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2011 1M
- 2012 10K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- 2024 10K
- 2024 30K
- 2024 100K
- 2024 300K
- Newscrawl
- Newscrawl-public
- Web
- Wikipedia
- Belgium
- Benin
- Burkina Faso
- Burundi
- Cameroon
- Canada
- Congo, (Congo & Kinshasa)
- Cote d'Ivoire (Ivory Coast)
- European Union
- France
- French Polynesia
- Gabon
- Guadeloupe
- Haiti
- Luxembourg
- Madagascar
- Mali
- Martinique
- Monaco
- New Caledonia
- Niger
- Reunion
- Rwanda
- Senegal
-
Switzerland
-
Web
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2015 10K
- 2015 30K
- 2015 100K
- 2015 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
-
Web
- Togo
- Tuvalu
-
News
- Friulian
- Galician
- Ganda
- Georgian
-
German
-
News
- 1995 10K
- 1995 30K
- 1995 100K
- 1995 300K
- 1996 10K
- 1996 30K
- 1996 100K
- 1996 300K
- 1997 10K
- 1997 30K
- 1997 100K
- 1997 300K
- 1998 10K
- 1998 30K
- 1998 100K
- 1998 300K
- 1999 10K
- 1999 30K
- 1999 100K
- 1999 300K
- 2000 10K
- 2000 30K
- 2000 100K
- 2000 300K
- 2001 10K
- 2001 30K
- 2001 100K
- 2001 300K
- 2002 10K
- 2002 30K
- 2002 100K
- 2002 300K
- 2003 10K
- 2003 30K
- 2003 100K
- 2003 300K
- 2004 10K
- 2004 30K
- 2004 100K
- 2004 300K
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2010 1M
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2012 1M
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2014 10K
- 2014 30K
- 2014 100K
- 2014 300K
- 2015 10K
- 2015 30K
- 2015 100K
- 2015 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- 2024 10K
- 2024 30K
- 2024 100K
- 2024 300K
- Newscrawl
- Newscrawl-public
- Web
- Wikipedia
- Austria
- Belgium
- COM
- European Union
- Germany
- Hungary
- Liechtenstein
- Luxembourg
- Namibia
- Poland
- Switzerland
-
News
- Gilaki
- Goan Konkani
- Guarani
- Gujarati
- Haitian
- Hausa
- Hebrew
- Hindi
- Hungarian
- Icelandic
- Ido
- Igbo
- Iloko
-
Indonesian
-
News
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Newscrawl-tufs5
- Newscrawl-tufs6
- Web
- Wikipedia
- Brunei
- COM
- India
- Indonesia
-
News
- Interlingua
- Interlingue
- Iranian Persian
- Irish
-
Italian
-
News
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2005-2009 10K
- 2005-2009 30K
- 2005-2009 100K
- 2005-2009 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2012 10K
- 2012 100K
- 2012 1M
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Web
- Wikipedia
- European Union
- San Marino
- Switzerland
-
News
-
Japanese
-
News
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2005-2008 10K
- 2005-2008 30K
- 2005-2008 100K
- 2005-2008 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2020 10K
- 2020 30K
- 2020 100K
- 2021 10K
- 2023 10K
- 2023 30K
- 2023 100K
- Newscrawl
- Wikipedia
- COM
- Japan
-
News
- Javanese
- Kabiyè
- Kalaallisut
- Kannada
- Karachay-Balkar
- Kashubian
- Kazakh
- Kirghiz
- Komi
- Komi-Permyak
- Konkani
-
Korean
-
News
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- Newscrawl
- Web
- Wikipedia
- Korea, South
-
News
- Kurdish
- Kölsch
- Ladino
- Latin
- Latvian
- Lezghian
- Ligurian
- Limburgan
- Lithuanian
- Lombard
- Low German
- Lower Sorbian
- Lushai
- Luxembourgish
- Macedonian
- Madurese
- Maithili
- Malagasy
- Malay
- Malayalam
- Maltese
- Mandarin Chinese
- Manx
- Maori
- Marathi
- Mazanderani
- Min Nan Chinese
- Minangkabau
- Mingrelian
- Mirandese
-
Modern Greek
-
News
- 2007 10K
- 2007 30K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Web
- Wikipedia
- European Union
- Greece
-
News
- Mongolian
- Navajo
- Neapolitan
- Nepali
- Newari
- North Azerbaijani
- Northern Frisian
- Northern Sami
- Northern Uzbek
- Norwegian
- Norwegian Bokmål
- Norwegian Nynorsk
- Occitan
- Oriya
- Oromo
- Ossetian
- Pampanga
- Panjabi
- Papiamento
- Pedi
- Persian
- Pfaelzisch
- Piemontese
- Plateau Malagasy
-
Polish
-
News
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2011 1M
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Wikipedia
- COM
- European Union
-
News
- Portuguese
- Pushto
- Quechua
- Romanian
- Romansh
-
Russian
-
News
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2013 1M
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Newscrawl-public
- Web
- Wikipedia
- Azerbaijan
- Estonia
- European Union
- Georgia
- Kazakhstan
- Kyrgyzstan
- Latvia
- Lithuania
- Moldova
- SU
- Tajikistan
- Tuvalu
- Ukraine
- Uzbekistan
-
News
- Rusyn
- Sami
- Samogitian
- Sanskrit
- Sardinian
- Saterfriesisch
- Scots
- Serbian
- Serbo-Croatian
- Shona
- Sicilian
- Silesian
- Sindhi
- Sinhala
- Slovak
- Slovenian
- Somali
- Southern Sotho
-
Spanish
-
News
- 2001-2002 10K
- 2001-2002 30K
- 2001-2002 100K
- 2001-2002 300K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2008 10K
- 2008 30K
- 2008 100K
- 2008 300K
- 2009 10K
- 2009 30K
- 2009 100K
- 2009 300K
- 2010 10K
- 2010 30K
- 2010 100K
- 2010 300K
- 2011 10K
- 2011 30K
- 2011 100K
- 2011 300K
- 2011 1M
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2013 10K
- 2013 30K
- 2013 100K
- 2013 300K
- 2016 10K
- 2016 30K
- 2016 100K
- 2016 300K
- 2017 10K
- 2017 30K
- 2017 100K
- 2017 300K
- 2018 10K
- 2018 30K
- 2018 100K
- 2018 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2021 10K
- 2021 30K
- 2021 100K
- 2021 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- 2024 10K
- 2024 30K
- 2024 100K
- 2024 300K
- Newscrawl
- Newscrawl-public
- Web
- Wikipedia
- Andorra
- Argentina
- Bolivia
- Colombia
- Costa Rica
- Cuba
- Dominican Republic
- Ecuador
- El Salvador
- European Union
- Guatemala
- Honduras
- Mexico
- Nicaragua
- Panama
- Paraguay
- Peru
- Puerto Rico
- United States
- Uruguay
- Venezuela
-
News
- Standard Estonian
- Standard Latvian
- Standard Malay
- Sundanese
- Swahili
- Swati
-
Swedish
-
News
- 2005 10K
- 2005 30K
- 2005 100K
- 2005 300K
- 2006 10K
- 2006 30K
- 2006 100K
- 2006 300K
- 2007 10K
- 2007 30K
- 2007 100K
- 2007 300K
- 2012 10K
- 2012 30K
- 2012 100K
- 2012 300K
- 2019 10K
- 2019 30K
- 2019 100K
- 2019 300K
- 2020 10K
- 2020 30K
- 2020 100K
- 2020 300K
- 2022 10K
- 2022 30K
- 2022 100K
- 2022 300K
- 2023 10K
- 2023 30K
- 2023 100K
- 2023 300K
- Newscrawl
- Web
- Wikipedia
- European Union
- Sweden
-
News
- Swiss German
- Tagalog
- Tajik
- Tamil
- Tatar
- Telugu
- Thai
- Tosk Albanian
- Tsonga
- Tswana
- Tulu
- Turkish
- Turkmen
- Tuvinian
- Udmurt
- Uighur
- Ukrainian
- Upper Sorbian
- Urdu
- Uzbek
- Venda
- Venetian
- Vietnamese
- Vlaams
- Volapük
- Võro
- Walloon
- Waray (Philippines)
- Welsh
- Western Frisian
- Western Mari
- Western Panjabi
- Wu Chinese
- Xhosa
- Yakut
- Yiddish
- Yoruba
- Yue Chinese
- Zeeuws
- Zulu
5.1.6 Language Fingerprint
Data Description
NN co-occurrences within the 10 most frequent words are presented in a table.
The graph below gives much more information. Here, the top-1000 words are plotted against each other and the dots indicate NN co-occurrences. The diameter of the dots increases with the significance of the co-occurrence. Both axis are scaled logarithmic to shift the emphasis to the top words.
Usage
The picture above is very typical for a language, therefore the name language fingerprint. Comparing these fingerprints for different languages one is able to identify determiners, prepositions etc. by its graphical properties.
Simplified Select statement
Frequency of the most frequent word:
select @maxfreq:=(select freq from words where w_id=101);
Table data:
select w1.word,w2.word,c.freq from co_n c, words w1, words w2 where w1.w_id=w1_id and w2.w_id=w2_id and w1_id>100 and w2_id>100 and 110>=w1_id and 110>=w2_id and c.freq>(select count(*) from sentences)/100000 order by w1.w_id;
Picture data:
select if(12>w1_id-99,w1.word,"-"),if(12>w2_id-99,w2.word,"-"),w1_id-99,w2_id-99,1/(log(c.freq/@maxfreq)*log(c.freq/@maxfreq)/20) from co_n c, words w1, words w2 where w1.w_id=w1_id and w2.w_id=w2_id and w1_id>100 and w2_id>100 and 1100>=w1_id and 1100>=w2_id and c.freq>(select count(*) from sentences)/100000;